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20 Method for ^i^f^r^^ i i2£lJ ^^g^ sequences stored on media 



such as motion-picture films, video tapes or such l ij^ 
into individual s equences 



25 Description 

The invention relates to a method for separating image 
sequences stored on media such as motion-picture films, 
video tapes or such like into individual sequences. 

30 

It is known to manually split successive scenes of a 
motion-picture film or video tape into individual 
sequences in order then to compile, discard or store 
these individual sequences, if appropriate in a 
35 different order. In this case, the 
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beginning of an individual sequence is usually 
initiated by an individual start image or a plurality 
of start images, for example by the recording of a film 
clapperboard with the assignment noted thereon. 

The image sequences may be contained on various 
recording media, such as motion-picture films, video 
tapes, electronic storage media such as CDs or the 
like. In many applications, recording is effected in 
parallel on motion-picture films and an electronic 
storage medium, the electronically stored image 
sequence being reflected out of an optical beam path of 
a motion-picture camera and being converted by means of 
a video chip or a video camera into video signals which 
are stored on the electronic storage medium. 

US-A-5, 537, 530 discloses a method for separating image 
sequences stored on video tapes into individual 
sequences, in which sequence changes of a first type 
which are based on a change in the mean brightness of 
successive images which exceed or fall below a 
predetermined amount and also sequence changes of a 
second type which are based on a change in the image 
content of successive images are detected and 
separation markers for the automatic separation of the 
image sequences into individual sequences are set. 

In numerous applications, automatic separation of, in 
particular, digitized films into individual sequences 
is desirable, without the need for manual separation or 
the recording of start images for introducing 
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an individual sequence. In the medical field, in 
particular, such automatic separation of digitized 
films into individual sequences is desirable in order 
that, directly after recording of the image sequences, 
individual sequences are made available for diagnosis. 
In this case, what is crucially important is that first 
no images are lost during the automatic separation, and 
that secondly a high identification rate is achieved 
for resolving the image sequence into individual 
sequences . 
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It is an object of the present invention to specify a 
method for automatic separation, in particular, of 
digitized motion-picture films, video recordings or 
such like, which guarantees a highest possible 
identification rate of the individual sequences and 
ensures that no images are lost during application of 
the separation method. 

This object is achieved according to the invention by 
means of the features of Claim 1. 

The solution according to the invention first 
15 guarantees a highest possible identification rate and 
secondly ensures the retention of all -the images of the 
m image sequences of a motion-picture film, video tape or 

,1 such like. 

^ 20 The solution according to the invention is suitable in 
Q particular for realization in a data processing device 

with corresponding hardware components and can be used 
both for stand-alone applications and in network 
systems and also for remote data transmissions. 

25 

Advantageous refinements of the method according to the 
invention can be gathered from the features of the 
subclaims . 

30 In the practical application, it proves to be 
advantageous to display a selected individual image, 
preferably the first individual image in each case, of 
an individual sequence as an icon on a monitor, so that 
the relevant individual sequence can be started by 
35 clicking on the icon. A sequence of individual 
sequences can be started for viewing by successively 
clicking on a plurality of icons. 
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The concept underlying the invention will be explained 
in more detail below using an exemplary embodiment. 

For the application of the method according to the 
invention and of the software derived therefrom for 
automatically separating digitized cardiological films 
into individual sequences, 35 mm motion-picture films 
and S-VHS video tapes are used as media in the 
exemplary embodiment. A total of three types of 
sequence changes can be observed on these media: 

1. On 35 mm motion-picture film (negative) two to three 
virtually white images, often up to three such 
sequence changes at short intervals (approximately 
three images) one after the other; 

2- On video tape up to 30 virtually black images; 

3. On video tape, at the end of the sequence, 10 to 15 
- disregarding noise - identical individual images, 
then start of the next sequence without specially 
marked intermediate images. 

The first two sequence changes are designated below as 
sequence changes of the first type, and the third 
sequence change as sequence change of the second type. 
These sequence changes of the first and second types 
are handled as follows: 

Sequence changes of the first type which are based on a 
great change in the mean brightness can be identified 
very reliably; with good image material it is possible 
to achieve an identification rate of 100%. 
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The separation is effected by setting separation 
markers of first and second types or sequence changes 
of the first and second types. A separation marker of 
the first type is a predetermined number of successive 
black or white images. The images identified as 
separation markers are themselves not stored. The first 
image after the separation marker is also the first 
image of the next sequence. The sequences themselves 
must contain at least a predetermined number of images, 
otherwise they are discarded. 

Sequence changes of the second type which are based on 
a change in the image content are significantly more 
difficult to identify since the size of the change 
varies and large deviations between successive images 
can occur even within a sequence. In many applications, 
only an identification rate of approximately 75% is 
achieved, i.e. not all sequence changes are identified 
as such and occasionally separation is performed within 
a sequence. It is guaranteed, however, that no images 
are lost. 

The separation is effected according to the following 
rules: 

a) A separation marker of the second type is an image 
whose content differs greatly from the contents of 
the preceding images; 

b) Separation markers of the first type always have 
priority; 
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c) Separation markers of the second type which are 
situated within a predetermined distance from 
separation markers of the first type are not taken 
into account; 

d) Separation markers of the second type are not taken 
into account if the preceding sequence does not 
contain at least a predetermined number of images; 

e) The image identified as separation marker is the 
first image of the next image. 

To set the behavior of the automatic separation method, 
the most important parameters - specified below - and 
also the following file names are set or specified in a 
file "splitter. ini" : 

a) The parameter MeanMinFrames specifies the least 
number of images that must be contained in the 
individual sequences which ' are terminated by 
separation markers of the first type. Shorter 
sequences are discarded. 

Since many films only contain very short sequences 
with the insertion of the patient's name 
(clapperboard) , given an internal predetermined 
value of 12 and a range of values > 0, a range of 
values for this parameter of 4 to 6 is recommended. 

b) The parameter MeanSpltFrames specifies the least 
number of images that a separation marker of the 
first type must comprise in order that separation 
is performed. The predetermined value is 2, the 
range of values is > 0. 
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c) The parameter . MeanSensitivity indicates the 
response sensitivity for separation markers of the 
first type from low to high with a range of values 
from 0,0 to 1.0. The value 0.0 denotes no checking 
for this criterion. In order that the beginning of 
a new sequence whose brightness differs greatly 
from that of the preceding sequence can be reliably 
identified, this value must not, however, be too 
high. Within the range of values specified above, a 
range of values from 0.25 to 0.35 is recommended. 

d) The parameter ChangeMinFrames specifies the least 
number of individual images that must be contained 
in sequences which are terminated by separation 
markers of the second type. In the case of shorter 
sequences, the separation marker is discarded - 
Moreover, all separation markers of the second type 
are discarded which do not have at least this 
distance from separation markers of the first type. 
Preferably, the predetermined value is 12 given a 
range of values of > 0. 

e) The parameter ChangeSensitivity indicates the 
response sensitivity for separation markers of the 
second type. Given a range of values from 0.0 to 
1.0, where the value 0.0 denotes no checking for 
this criterion, the value 0.7 is recommended for 
average video material. 

f) The file SpItDatpath ("splitmarks.dat") indicates 
the file into which a list of separation markers is 
written. It is preferably valid only for a debug 
version of the program. 
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g) The file SeqDatPath ("sequences.dat") denotes the 
file in which the sequence list is stored unless a 
different file name was specified on the command 
line. 

The automatic sequence separation can be activated 
separately for each video source in a set up window of 
a recording software. It is effected after the storage 
of the raw data on a hard disk and prior to further 
processing to form DICOM data records. In this case, 
the processing speed is approximately 500 to 1000 
images per second. The complete path name of the 
program "splitter.exe" is entered as a parameter in the 
file VIM.IM of the recording software. 

In a standard installation directory for the files 
"splitter.exe" and "splitter.ini", the following files 
are generated in accordance with the presetting: 

1, A logging file "splitter.log"; 

2. A list of the separation markers "splitmarks.dat" 
for a debug version; 



3. A list of the individual sequences "sequences.dat". 
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In order to form the algorithm, each image is firstly 
examined with regard to separation markers of the first 
type. If no such marker is found, a search is made for 
separation markers of the second type. Once a 
provisional list for the possible separation markers 
has been created in this way, post-processing is 
effected in order to determine the individual 
sequences . 

The function CheckSplitMean is used to find the 
separation markers of the first type. A moving mean 
value (MeanMean) of the image brightnesses is 
calculated in each case over the last 16 (MEANFRAMES) 
images. From said mean value and the parameter mean 
sensitivity, a lower (LThresh) and upper (UThresh) 
threshold value are determined as follows: 

LThresh = MeanSensitivity * MeanMean 

UTresh = 255 - MeanSensitivity * (255 - MeanMean) 

If the mean value of the current image exceeds UThresh, 
then a white separation marker {SPLT_WHITE) is set, and 
if it falls below LThresh, then a black separation 
marker (SPLT_BLACK) is set. In this case, the mean 
values of the separation marker images do not enter 
into the moving average. 

The function CheckSplitChange is used to find 
separation markers of the second type by calculation of 
the RMS deviation (CurrRmsDif f ) of the pixel 
brightnesses between the current image and the 
preceding image. A moving mean value (MeanRmsDif f ) of 
the RMS deviations is determined over the last 16 

(MEANFRAMES) image changes and from this and from the 
parameter ChangeSensitivity a threshold value 

(DiffThresh) is determined as follows: 
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DiffThresh = (8 - 6 * ChangeSensitivity) * MeanRmsDiff 

If the RMS deviation of the current image change 
exceeds the threshold value, then a separation marker 
(SPLT_CHANGE) is set. RMS deviations of separation 
markers of the second type enter into the moving mean 
value, but those of the first type do not. 

The function EvaluateSplit is used to determine the 
individual sequences from the separation marker list 
with the following proviso: 

1. All separation marker sequences of the first type 
which are shorter than the number MeanSpltFrames of 
images are discarded. 

2. All separation markers of the second type which lie 
nearer to the remaining separation markers of the 
first type than ChangeMinFrames images are 
discarded. 

The individual sequences thus formed start 

1. with the first image in the file or 

2. with the first image after a separation marker of 
the first type or 

3. with a separation marker of the second type3. 



and end 
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1. with the last image in the file or 

2. with the last image before a separation marker of 
the first type, if it is at least MeanMinFrames 
images long, otherwise the sequence is discarded, or 

3. with the last image before a separation marker of 
the second type, if it is at least ChangeMinFrames 
images long. Otherwise, the separation marker is 
discarded. 



